REPORT  DOCUMENTATION  PAGE 


Form  Approved  OMB  NO.  0704-0188 


The  public  reporting  burden  for  this  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions, 
searching  existing  data  sources,  gathering  and  maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments 

regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information,  including  suggesstions  for  reducing  this  burden,  to  Washington 

Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington  VA,  22202-4302. 
Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  any  oenalty  for  failing  to  comply  with  a  collection  of 
information  if  it  does  not  display  a  currently  valid  OMB  control  number. 

PLEASE  DO  NOT  RETURN  YOUR  FORM  TO  THE  ABOVE  ADDRESS. 


1.  REPORT  DATE  (DD-MM-YYYY) 


2.  REPORT  TYPE 
New  Reprint 


4.  TITLE  AND  SUBTITLE 

Optical  Element,  Device,  Method,  and  Applications 


3.  DATES  COVERED  (From  -  To) 


5a.  CONTRACT  NUMBER 
W91  INF-09-1-0425 


5b.  GRANT  NUMBER 


6.  AUTHORS 

Wanli  Chi,  Nicholas  George 


5c.  PROGRAM  ELEMENT  NUMBER 
611102 


5d.  PROJECT  NUMBER 


5e.  TASK  NUMBER 


5f.  WORK  UNIT  NUMBER 


7.  PERFORMING  ORGANIZATION  NAMES  AND  ADDRESSES 

University  of  Rochester 
ORPA 

University  of  Rochester 

Rochester,  NY  14627  -0000 


9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND 
ADDRESS(ES) 

U.S.  Army  Research  Office 
P.O.Box  12211 

Research  Triangle  Park,  NC  27709-2211 


8.  PERFORMING  ORGANIZATION  REPORT 
NUMBER 


10.  SPONSOR/MONITOR'S  ACRONYM(S) 
ARO 


11.  SPONSOR/MONITOR'S  REPORT 
NUMBER(S) 

56533-PH.12 


12.  DISTRIBUTION  AVAILIBILITY  STATEMENT 
Approved  for  public  release;  distribution  is  unlimited. 


13.  SUPPLEMENTARY  NOTES 

The  views,  opinions  and/or  findings  contained  in  this  report  are  those  of  the  author(s)  and  should  not  contrued  as  an  official  Department 
of  the  Army  position,  policy  or  decision,  unless  so  designated  by  other  documentation. 


14.  ABSTRACT 

A  novel  phase-coded  aperture,  associated  imaging  system,  and  design  method  is  disclosed.  The  optical  imaging 
system  includes  a  coded-aperture  followed  optically  by  a  detector  array  and  includes  an  image  processor.  A 
diffraction  pattern  in  the  form  of  a  band-limited  uniformly  redundant  array  is  formed  on  the  detector  array  when 
focusable  radiation  from  a  point  source  in  object  space  is  modulation  by  the  transmission  function  of  the 
coded-aperture.  Since  diffraction  effect  cannot  be  ignored  in  the  optical  regime,  an  iterative  phase  retrieval  method 


15.  SUBJECT  TERMS 

correlation  optical  receiver;  image  retrieval;  redundant  array;  x-ray  camera;  computational  imaging;  bandlillmited  redundant  array 


16.  SECURITY  CLASSIFICATION  OF: 

17.  LIMITATION  OF 

15.  NUMBER 

19a.  NAME  OF  RESPONSIBLE  PERSON 

a.  REPORT 

b.  ABSTRACT 

c.  THIS  PAGE 

ABSTRACT 

OF  PAGES 

Nicholas  George 

UU 

UU 

UU 

UU 

19b.  TELEPHONE  NUMBER 

585-275-2417 

Standard  Form  298  (Rev  8/98) 
Prescribed  by  ANSI  Std.  Z39. 1 8 


Report  Title 

Optical  Element,  Device,  Method,  and  Applications 

ABSTRACT 

A  novel  phase-coded  aperture,  associated  imaging  system,  and  design  method  is  disclosed.  The  optical  imaging 
system  includes  a  coded-aperture  followed  optically  by  a  detector  array  and  includes  an  image  processor.  A 
diffraction  pattern  in  the  form  of  a  band-limited  uniformly  redundant  array  is  formed  on  the  detector  array  when 
focusable  radiation  from  a  point  source  in  object  space  is  modulation  by  the  transmission  function  of  the 
coded-aperture.  Since  diffraction  effect  cannot  be  ignored  in  the  optical  regime,  an  iterative  phase  retrieval  method  is 
used  to  calculate  the  phase-coded  aperture  transmission  function.  Correlation  type  processing  can  be  applied  for  the 
image  recovery. 


REPORT  DOCUMENTATION  PAGE  (SF298) 
(Continuation  Sheet) 


Continuation  for  Block  13 


ARO  Report  Number  56533. 12-PH 
Optical  Element,  Device,  Method,  and  Applicatio 


Block  13:  Supplementary  Note 

©2011  .  Published  in  United  States  Patent  Application  Publication,  Pub.  No.:  US  2011/0085051  A1,  Vol.  Ed.  0  (2011),  (Ed.  ). 
DoD  Components  reserve  a  royalty-free,  nonexclusive  and  irrevocable  right  to  reproduce,  publish,  or  otherwise  use  the  work  for 
Federal  purposes,  and  to  authroize  others  to  do  so  (DODGARS  §32.36).  The  views,  opinions  and/or  findings  contained  in  this 
report  are  those  of  the  author(s)  and  should  not  be  construed  as  an  official  Department  of  the  Army  position,  policy  or  decision, 
unless  so  designated  by  other  documentation. 

Approved  for  public  release;  distribution  is  unlimited. 


US  201 1008505 1A1 


(is)  United  States 

(i2)  Patent  Application  Publication  (i<»  Pub.  No.:  US  2011/0085051  Al 
Chi  et  al.  (43)  Pub.  Date:  Apr.  14, 2011 


(54)  OPTICAL  ELEMENT,  DEVICE,  METHOD, 
AND  APPLICATIONS 


(75)  Inventors:  Wanli  Chi,  Rochester,  NY  (US); 

Nicholas  George,  Pittsford,  NY 
(US) 


Publication  Classification 


(51) 

Int.  Cl. 

H04N  5/228 

(2006.01) 

G02F  1/35 

(2006.01) 

(52) 

U.S.  Cl . 

.  348/222.1;  359/326;  348/E05.031 

(57) 

ABSTRACT 

(73)  Assignee: 

(21)  Appl.No.: 

(22)  Filed: 


UNIVERSITY  OF  ROCHESTER, 

Rochester,  NY  (US) 

12/898,060 
Oct.  5,  2010 


Related  U.S.  Application  Data 

(60)  Provisional  application  No.  61/250,224,  filed  on  Oct. 
9,  2009. 


A  novel  phase-coded  aperture,  associated  imaging  system, 
and  design  method  is  disclosed.  The  optical  imaging  system 
includes  a  coded-aperture  followed  optically  by  a  detector 
array  and  includes  an  image  processor.  A  diffraction  pattern 
in  the  form  of  a  band-limited  uniformly  redundant  array  is 
formed  on  the  detector  array  when  focusable  radiation  from  a 
point  source  in  object  space  is  modulation  by  the  transmission 
function  of  the  coded-aperture.  Since  diffraction  effects  can¬ 
not  be  ignored  in  the  optical  regime,  an  iterative  phase 
retrieval  method  is  used  to  calculate  the  phase-coded  aperture 
transmission  function.  Correlation  type  processing  can  be 
applied  for  the  image  recovery. 


Object 

O 


Phase 

Screen 


60 


100-1 


90 


Patent  Application  Publication  Apr.  14,  2011  Sheet  1  of  9 


US  2011/0085051  A1 


Object 

O 

# 


Phase 

Screen 


90 


FIG.  1A 


Patent  Application  Publication  Apr.  14,  2011  Sheet  2  of  9 


US  2011/0085051  A1 


100-2 

\ 


Aperture  / 


50- 


Reflective 

Spatial 

Light 

Modulator 
Phase  Screen 


Controller 


Phase  Screen  Profile 


FIG.  IB 


.  ... ... . 


Patent  Application  Publication  Apr.  14,  2011  Sheet  4  of  9 


US  2011/0085051  A1 


5  in  i  n 

t  if  i  i 

5  m  l  i  i_  o 

&  Bi  *  ife  Hi  ij;  ; 
mm&  t i  &  s  i 

ji  „  ,  ,1  a ; . 

zdi  *  c^'Cv  r 

R»  «  t  «  es  l  f  t  i  ;  ■ 

1^  _J»M  ^  *  i% 

ZTi  i»Vi  "  Vm 

«•*  i  *  a  ii.i  1 1  !#ji 
» #'*T<iV  fc  *  i*" 


r  inrir^  i  rnw  sttfi 

I  3  II!  *8  ®  *.  ‘  8  <**  »  BUS**' 


BY-* 

ir  m  1  J**,*, 
it  $  s  '  iss  ®  ‘ 
,  ,j5„§ 

X,,!!"iCsi 

*!  *  »  *«  » 

I  Hi  HI  1  g 


at  t  irt  *«  a 

II 

a  i 

i  i  a  t_  •»  »  <aas 

)j  t  y*  ;> « ♦’«»» 

ait  nice  i 
i  tails  •  i  »«b 


i  Hits  as  I  3t«* 
«M  , 

if* l*  :ij  1 1  *’  ’  t 


St  I  I  II 


*»«'  c  «is  it  r  it 
gM&&  i  «* ' Vi  i » i  r 


8  i  HI  4  B 

it  *  a  g  in  is 
.  it* *  *  .  iu  * 

i  Yiii  f*  »  fm  u  ‘  ii «« 

II  »Hi  _  i 

«i*  «fV  *'m*'  '  -  '  "  "•  '  "V“ 

«  '  *  ■  -  -  1  *  •  ;  •  **** 


4*fH  \ 


IB  I  ii  Hi  *  i  ■  r  I  I  i  1  i  tt  i  *4» 


301 


Patent  Application  Publication  Apr.  14,  2011  Sheet  5  of  9 


US  2011/0085051  A1 


FIG.  4 


Patent  Application  Publication 


Apr.  14,2011  Sheet  6  of  9 


US  2011/0085051  A1 


507 


500 


508 


FIG.  5 


Patent  Application  Publication 


Apr.  14,  2011  Sheet  7  of  9 


US  2011/0085051  A1 


FIG.  6 


Patent  Application  Publication 


Apr.  14,2011  Sheet  8  of  9 


US  2011/0085051  A1 


FIG.  7 


Patent  Application  Publication  Apr.  14,  2011  Sheet  9  of  9 


US  2011/0085051  A1 


■MBs 


Cross 

correlation 


0 


Recovered  image 
(half  size  of 
intermediate  image) 


FIG.  8 


US  2011/0085051  A1 


1 


Apr.  14,2011 


OPTICAL  ELEMENT,  DEVICE,  METHOD, 

AND  APPLICATIONS 

CROSS-REFERENCE  TO  RELATED 
APPLICATIONS 

[0001]  This  application  claims  priority  to  U.S.  provisional 
Patent  Application  Ser.  No.  61/250,224  filed  on  Oct.  9, 2009, 
the  content  of  which  is  incorporated  herein  by  reference  in  its 
entirety. 

FEDERALLY  SPONSORED  RESEARCH 

[0002]  This  invention  was  made  with  government  support 
from  the  U.S.  Army  Research  Office  under  contract  number 
W91  INF-09-1-0425.  The  government  has  rights  in  this 
invention. 

BACKGROUND  OF  THE  INVENTION 
[0003]  1.  Field  of  the  Invention 

[0004]  Embodiments  of  the  present  invention  relate  gener¬ 
ally  to  coded  aperture  optics,  systems,  and  methods  operable 
with  and  pertaining  to  focusable  radiation  and,  more  particu¬ 
larly,  to  an  optical  element  for  generating  a  band-limited 
uniformly  redundant  array  (bl-URA)  from  light  within  a 
spectrum  of  focusable  radiation,  an  optical  imaging  device 
incorporating  the  optical  element,  and  a  method  for  determin¬ 
ing  a  transmission  function  P(§,  r|)  for  an  optical  element  that 
will  generate  a  desired  intensity  pattern  A(x,y)  on  a  detector 
from  light  within  a  spectrum  of  focusable  radiation  from  a 
point  on  an  object. 

[0005]  2.  Technical  Background 

[0006]  Conventional  refractive  and  reflective  optical  com¬ 
ponents  (e.g.,  lenses,  mirrors)  are  not  useful  for  imaging 
nonfocusable  radiation  such  as,  e.g.,  y-rays  and  X-rays.  The 
comparatively  shorter  wavelengths  simply  do  not  refract  in 
the  more  suitable  manner  of  comparatively  longer  wave¬ 
lengths  in,  e.g.,  the  visible  spectrum.  However,  a  simple  pin¬ 
hole  camera  can  be  used  as  an  imaging  device  for  y-rays  and 
X-rays  because  diffraction  effects  are  minimal,  in  contrast  to 
those  effects  in  the  UV  to  sub-millimeter  and,  particularly  the 
visible,  regime,  which  cannot  be  ignored. 

[0007]  The  concept  of  using  a  coded  aperture  to  image 
nonfocusable  radiation  was  first  introduced  by  L.  Mertz  and 
N.  Young,  Proc.  Conf.  Optical  Instruments  and  Techniques, 
London  1961,  p.  305  and  later  implemented  with  random 
arrays  by  R.  H.  Dicke,  Astrophys.  J.  153,  L  101  (1968)  and  J. 
G.  Abies,  Proc.  Astron.  Soc.  Aust.  4, 172  (1968);  see  also  U.S. 
Pat.  No.  3,700,895).  In  the  formulation  by  Dicke  and  Abies, 
the  opening  of  a  single  pinhole  camera  was  replaced  by  many 
randomly  arranged  pinholes  collectively  known  as  the  aper¬ 
ture.  Each  point  of  a  self-luminous  object  projected  a  shadow 
of  the  aperture  on  a  recorded  image  plane  (picture).  Subse¬ 
quent  correlation  processing  of  the  picture  yielded  a  recon¬ 
structed  image  that  resembled  the  original  self-luminous 
objects. 

[0008]  Uniformly  redundant  arrays  (URAs)  used  for  coded 
aperture  imaging  were  first  disclosed  by  Edward  E.  Fenimore 
et  al.  in  U.S.  Pat.  No.  4,209,780  as  well  as  in  Applied  Optics, 
17,  p.337,  Feb.  1, 1980,  Applied  Optics,  17,  p.  3562,  Nov.  16, 
1978,  Applied  Optics,  18,  p.  945,  Apr.  1,  1979,  and  in  Los 
Alamos  Scientific  Laboratory  Mini-Review,  LASL-78-102, 
January  1979.  U.S.  Pat.  Nos.  4,360,797  and  4,389,633  dis¬ 
close  further  information  about  coded  aperture  imaging. 


[0009]  A  variety  of  coded  aperture  systems  pertaining  to 
the  optical  regime  are  reported  in  David  P.  Casasent,  Timothy 
Clark  (Ed.),  Proc.  SPIE  6714  (2007);  David  P.  Casasent, 
Stanley  Rogers  (Ed.),  Proc.  SPIE  7096  (2008);  Keith  Lewis, 
Proc.  SPIE  6714  (2007)  671402;  and  Tim  Clark,  Esko  Jaska, 
Proc.  SPIE  6714  (2007)  671403. 

[0010]  The  inventors  have  recognized  the  many  benefits 
and  advantages  realizable  by  a  coded  aperture  optics  operable 
over  the  focusable  radiation  spectrum. 

SUMMARY 

[0011]  An  embodiment  of  the  invention  is  an  optical  ele¬ 
ment  for  generating  a  band-limited  uniformly  redundant 
array  (bl-URA)  from  light  within  a  spectrum  of  focusable 
radiation.  The  embodiment  includes  an  optical  element  char¬ 
acterized  by  a  light  transmission  function,  P(§,  r|),  such  that 
light  within  the  spectrum  of  focusable  radiation  incident  on 
the  optical  element  from  a  point  location  in  an  object  space  of 
the  optical  element  is  optically  transformed  by  P(|,  r|)  into  a 
band-limited  uniformly  redundant  array  (bl-URA),  A(x,y),  in 
an  image  space  of  the  optical  element.  The  optical  element 
may  consist  of  only  a  single  optical  element.  The  optical 
element  may  have  a  surface  region  that  is  at  least  partially 
transmissive  for  the  light  within  the  spectrum  of  focusable 
radiation.  The  optical  element  may  have  a  surface  region  that 
is  at  least  partially  reflective  for  the  light  within  the  spectrum 
of  focusable  radiation.  The  optical  element  may  be  an  ampli¬ 
tude-only  aperture.  The  optical  element  may  be  a  phase-only 
aperture.  The  optical  element  may  be  a  combination  ampli¬ 
tude/phase  aperture.  The  optical  element  may  consist  of  a 
single  refractive  optical  component.  The  optical  element  may 
consist  of  a  plurality  of  refractive  optical  components.  The 
optical  element  may  comprise  a  refractive  optical  component 
and  a  phase  aperture.  The  optical  element  may  be  a  program¬ 
mable  spatial  light  modulator.  According  to  the  embodiment, 
A(x,y )  is  a  real,  non-negative,  band-limited,  uniformly  redun¬ 
dant  array  (bl-URA).  The  spectrum  of  focusable  radiation  is 
in  a  range  from  ultraviolet  to  sub-millimeter  wavelengths. 
The  spectrum  of  focusable  radiation  may  be  in  a  range  from 
visible  to  infrared  wavelengths. 

[0012]  An  embodiment  of  the  invention  is  an  optical  imag¬ 
ing  device.  The  optical  imaging  device  includes  an  optical 
element  characterized  by  a  light  transmission  function,  P(|, 
r|),  such  that  light  within  the  spectrum  of  focusable  radiation 
incident  on  the  optical  element  from  a  point  location  in  an 
obj  ect  space  of  the  optical  element  is  optically  transformed  by 
P(i;,  r) )  into  a  band-limited  uniformly  redundant  array  (bl- 
URA),  A(x,y),  in  an  image  space  of  the  optical  element;  a 
detector  disposed  in  the  image  space  such  that  the  bl-URA  is 
formed  on  the  detector;  and  an  image  processor  adapted  to 
recover  an  image  of  an  object  from  the  detected  bl-URA. 
According  to  the  embodiment,  A(x,y)  is  a  real,  non-negative, 
band-limited,  uniformly  redundant  array  (bl-URA). 

[0013]  An  embodiment  of  the  invention  is  a  method  for 
determining  a  transmission  function  P(|,  r|)  for  an  optical 
element  that  will  generate  a  desired  intensity  pattern  A(x,y) 
on  a  detector  from  light  within  a  spectrum  of  focusable  radia¬ 
tion  from  a  point  on  an  object.  The  method  includes  the  steps 
of:  determining  a  real,  non-negative,  band-limited  uniformly 
redundant  array,  A(x,y),  that  will  be  generated  on  a  detector 
by  an  optical  element  characterized  by  a  transmission  func¬ 
tion  !’('£;,  r]),  from  light  within  the  spectrum  of  focusable 
radiation  from  a  point  on  the  object;  defining  an  electric  field 
having  an  amplitude  E(x,y)=[A(x,y)]1/2;  calculating  the 
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transmission  function  P(|,  r| )  in  a  plane  immediately  adjacent 
a  known  position  of  the  optical  element  by  performing  a  free 
space  back  propagation,  and  denoting  the  transmission  func¬ 
tion  IP(lj,  r|)lexp[i<j)(i;,r|)];  determining  an  electric  field  at  a 
known  detector  plane  location  by  performing  a  free  space 
propagation,  and  denoting  this  electric  field  F(x,y)exp[iv|)(x, 

y)l; 

[0014]  applying  a  detector  plane  intensity  constraint  by 
setting  F(x,y)— »[A(x,y)]1/2;  performing  another  free  space 
back  propagation;  and  calculating  the  optical  element  trans¬ 
mission  function  P(§,  r|)  that  will  generate  the  desired  inten¬ 
sity  pattern  A(x,y).  According  to  an  illustrative  aspect  in 
which  the  optical  element  is  a  phase-only  element,  the 
method  includes  the  further  steps  of:  setting  an  aperture  con¬ 
straint  such  that  IP(|,  r|)l  is  set  to  1 ,  after  the  step  of  calculat¬ 
ing  the  transmission  function  P(^,  r|);  and  repeating  the  steps 
of:  calculating  the  transmission  function  P(i;,  rj)  in  a  plane 
immediately  adjacent  a  known  position  of  the  optical  element 
by  performing  a  free  space  back  propagation,  and  denoting 
the  transmission  function  IP(§,  r|)lexp[i<|>(l;,r|)];  determining 
an  electric  field  at  a  known  detector  plane  location  by  per¬ 
forming  a  free  space  propagation,  and  denoting  this  electric 
field  F(x,y)exp[ii|j(x,y)];  applying  a  detector  plane  intensity 
constraint  by  setting  F(x,y)-»[A(x,y)]1/2;  and  performing 
another  free  space  back  propagation.  According  to  another 
illustrative  aspect  in  which  the  optical  element  is  an  ampli¬ 
tude-only  element,  the  method  includes  the  further  steps  of: 
setting  an  aperture  constraint  by  setting  <()(§,  r| )  to  0,  after  the 
step  of  calculating  the  transmission  function  P(lj,  r|);  and 
repeating  the  steps  of:  calculating  the  transmission  function 
P(|,  r|)  in  a  plane  immediately  adjacent  a  known  position  of 
the  optical  element  by  performing  a  free  space  back  propa¬ 
gation,  and  denoting  the  transmission  function  IP(|,  r|)lexp 
[icj)(§,r|)];  determining  an  electric  field  at  a  known  detector 
plane  location  by  performing  a  free  space  propagation,  and 
denoting  this  electric  field  F(x,y)exp[iif(x,y)];  applying  a 
detector  plane  intensity  constraint  by  setting  F(x,y)-^[A(x, 
y)]1/2;  and  performing  another  free  space  back  propagation. 
[0015]  Additional  features  and  advantages  of  the  invention 
will  be  set  forth  in  the  detailed  description  which  follows,  and 
in  part  will  be  readily  apparent  to  those  skilled  in  the  art  from 
that  description  or  recognized  by  practicing  the  invention  as 
described  herein,  including  the  detailed  description  which 
follows,  the  claims,  as  well  as  the  appended  drawings. 

[0016]  It  is  to  be  understood  that  both  the  foregoing  general 
description  and  the  following  detailed  description  are  merely 
exemplary  of  the  invention,  and  are  intended  to  provide  an 
overview  or  framework  for  understanding  the  nature  and 
character  of  the  invention  as  it  is  claimed.  The  accompanying 
drawings  are  included  to  provide  a  further  understanding  of 
the  invention,  and  are  incorporated  in  and  constitute  a  part  of 
this  specification.  The  drawings  illustrate  various  embodi¬ 
ments  of  the  invention,  and  together  with  the  description 
serve  to  explain  the  principles  and  operation  of  the  invention. 

BRIEF  DESCRIPTION  OF  THE  DRAWINGS 

[0017]  FIG.  1A  shows  a  schematic  diagram  of  a  coded 
aperture  imaging  system  in  which  the  optical  element  is  a 
transmission-type  phase-only  coded  aperture,  according  to  a 
non-limiting,  illustrative  embodiment  of  the  invention;  FIG. 
IB  shows  a  schematic  diagram  of  a  coded  aperture  imaging 
system  in  which  the  optical  element  is  a  reflective  spatial  light 
modulator  phase  screen,  according  to  an  alternative,  illustra¬ 
tive  aspect  of  the  invention; 


[0018]  FIG.  2  shows  an  exemplary  uniformly  redundant 
array  (URA)  as  known  in  the  art  of  X-ray  imaging; 

[0019]  FIGS.  3 (a,  b)  show  a  digitally  constructed  point 
spread  function  (PSF)  from  the  URA  of  FIG.  2  and  the  phase 
screen  used  to  generate  the  PSF,  respectively,  according  to  an 
illustrative  embodiment  of  the  invention; 

[0020]  FIGS.  4(a,b,c )  show  the  imaging  results  of  a  coded 
aperture  camera  according  to  an  illustrative  aspect  of  he 
invention,  specifically  (a)  the  object;  (b)  the  recovered  image 
according  to  an  illustrative  aspect  of  the  invention;  and  (c)  a 
comparative  image  from  a  diffraction  limited  lens; 

[0021]  FIG.  5  is  a  flow  chart  diagram  illustrating  the  steps 
of  a  phase-only  screen  design  method  according  to  a  non¬ 
limiting,  exemplary  embodiment  of  the  invention; 

[0022]  FIG.  6  shows  a  coded  aperture  system  recovered 
image  according  to  an  illustrative  aspect  of  the  invention; 
[0023]  FIG.  7  shows  simulated  imaging  results  of  a  coded 
aperture  system  in  the  optical  regime  with  a  grey  scale  object; 
specifically,  (a)  a  diffraction  limited  image  and  (b)  a  recov¬ 
ered  image  using  a  coded  aperture  system  according  to  an 
exemplary  aspect  of  the  invention;  and 
[0024]  FIG.  8  shows  a  point  source  object  and  image  recov¬ 
ery  using  the  system  illustrated  in  FIG.  IB,  according  to  an 
illustrative  embodiment  of  the  invention. 

DETAILED  DESCRIPTION  OF  EMBODIMENTS 
OF  THE  INVENTION 

[0025]  Reference  will  now  be  made  in  detail  to  the  present 
exemplary  embodiments  of  the  invention,  non-limiting 
examples  of  which  are  illustrated  in  the  accompanying  draw¬ 
ings.  Wherever  possible,  the  same  reference  numbers  will  be 
used  throughout  the  drawings  to  refer  to  the  same  or  like  parts . 
[0026]  As  used  herein,  the  term  “focusable”  radiation  or 
light  when  used  in  conjunction  with  the  embodied  optical 
element  for  generating  a  band-limited  uniformly  redundant 
array  (bl-URA),  means  electromagnetic  radiation  spanning 
the  UV  through  IR  spectrum,  which  can  be  focused  by  a 
refractive  or  a  reflective  optical  component,  unlike  gamma 
(y)-  or  X-rays,  which  are  referred  to  in  the  art  as  nonfocusable 
radiation.  The  term  “focusable”  radiation  or  light,  when  used 
in  conjunction  with  the  embodied  optical  imaging  device, 
additionally  refers  to  wavelengths  for  which  diffraction 
effects  are  no  longer  negligible,  as  understood  in  the  art. 
[0027]  The  exemplary  optical  element  and  imaging  device 
embodiments  described  in  detail  below  will  be  discussed,  for 
convenience,  substantially  in  terms  of  a  transmission-type 
phase-only  coded  aperture  optical  element  and  imaging 
device  using  same.  However,  a  person  skilled  in  the  art  would 
appreciate  that  reflection-based  elements  and  systems  as  well 
as  amplitude-only  and  combination  amplitude/phase  optical 
elements,  all  of  which  operate  under  the  same  basic  principles 
as  the  transmission-type  phase-only  coded  aperture  optical 
element  and  imaging  device,  are  merely  alternative  aspects 
and  are  covered  as  if  fully  and  expressly  set  forth  herein.  That 
is,  in  the  optical  element  embodiment,  all  of  the  various 
aspects  referred  to  immediately  above  will  be  characterized 
by  a  light  function,  P(|,  r|),  such  that  light  within  the  spectrum 
of  focusable  radiation  incident  on  the  optical  element  from  a 
point  location  in  an  object  space  of  the  optical  element  is 
optically  transformed  by  P(^,  r|)  into  a  band-limited  uni¬ 
formly  redundant  array  (bl-URA),  A(x,y),  in  an  image  space 
of  the  optical  element.  Thus  the  term  Tight  transmission 
function’  represented  by  P(^,  r|)  is  used  herein  without  limi¬ 
tation  to  a  ‘transmission-type’  coded-aperture  optical  ele- 
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ment,  imaging  device,  and  method,  but  is  equally  applicable 
to  reflection-based  aspects  as  well. 

[0028]  FIG.  1A  schematically  illustrates  a  transmission- 
type  phase-coded  optical  imaging  system  100-1  and  includes 
an  optical  phase-only  screen  50,  also  referred  to  herein  as  a 
phase-coded  aperture  optical  element.  An  object  having  an 
object  point  O  is  shown  in  FIG.  1A  since  the  system  100  is  an 
‘imaging’  system;  however,  the  object  O  is  not  part  of  the 
embodied  invention  per  se. 

[0029]  Focusable  light  from  a  point  O  in  the  object  (i.e.,  the 
object  is  incoherently  illuminated)  on  an  object  side  (i.e.,  to 
the  left  of  the  phase-only  aperture  50 )  of  the  system  is  incident 
on  the  aperture.  The  phase-only  aperture  50  has  an  aperture  D 
and  a  transmission  function  P(lj,  r|)  that  defines  the  electric 
field  amplitude  transmission  of  the  phase-only  screen.  The 
electric  field  at  plane  I  immediately  after  the  phase-only 
screen  for  the  point  object  O  is  represented  by  exp[i(|>(l;,  r|)]. 
The  incoming  wavefront  from  the  obj  ect  point  O  is  modulated 
by  the  transmission  function  P(§,  r|)  of  the  coded-aperture  50 
and  forms  a  specific  coded  intensity  pattern  A(x,  y)  (i.e.,  a 
coded  image  70;  a  point  spread  function  (PSF))  on  a  detector 
array  60  located  at  plane  II,  which  is  disposed  a  distance  z 
from  plane  I.  Subsequent  image  processing  of  the  coded 
image  70  using  iterative  phase  retrieval  methods  to  perform 
correlation-type  image  processing  via  an  image  processor  90 
(both  described  in  further  detail  below)  leads  to  recovery  80 
of  the  object. 

[0030]  The  exemplary  optical  imaging  device  100-1  illus¬ 
trated  in  FIG.  1A  can  operate  as  a  computational  imaging 
camera.  Such  a  camera  essentially  consisting  only  of  a  coded 
aperture,  a  detector  array,  and  an  image  processor  provides  a 
lossless  sensitive  apparatus  that  includes,  but  is  not  limited  to, 
the  following  attributes  over  a  traditional  camera:  lighter 
weight,  ultra-thin  device;  high  resolution  with  pixel  size 
below  the  current  color  cross-talk  limit  defined  by  conven¬ 
tional  color  filters;  potential  multi-spectral  imaging  capabil¬ 
ity  in  a  single  CMOS  detector;  wide  dynamic  range;  wide 
field  of  view;  potential  extended  depth  of  field.  These 
attributes  provide  benefits  and  advantages  for,  but  not  limited 
to,  the  following  applications:  satellite  camera;  computa¬ 
tional  imaging  solutions  that  provide  object  attributes  (e.g., 
velocity,  range)  in  addition  to  an  image  of  an  object;  improved 
IR  imaging  solutions  that  reduce  or  eliminate  the  need  to 
thermally  compensate  IR  lens  materials;  mechanically  simple 
microscopes  and  telescopes;  and  ultra-compact  consumer 
cameras. 

[0031]  There  are  three  basic  problems  associated  with  and 
solved  by  the  instant  invention:  finding  an  appropriate  inten¬ 
sity  pattern  for  the  point  spread  function  A(x,  y);  finding  the 
coded-aperture  transmission  function  P(i;,  T|)  that  will  gener¬ 
ate  the  corresponding  pattern  A(x,  y)  when  focusable  radia¬ 
tion  from  a  point  location  in  object  space  is  incident  on  the 
coded-aperture;  and,  finding  the  recovered  object  by  image 
processing. 

[0032]  According  to  the  embodied  invention,  the  intensity 
pattern  A(x,  y)  formed  on  the  detector  should  be  similar  (but 
novel  as  described  below)  to  a  uniformly  redundant  array 
(URA)  as  is  typically  used  in  an  X-ray  camera  (which  is  not 
band-limited),  and  P(£;,  r|)  will  be  the  transmission  function 
that  forms  this  URA  when  focusable  radiation  from  a  point 
location  in  object  space  is  incident  on  the  coded-aperture 
having  such  a  transmission  function.  While  in  the  X-ray  cam¬ 
era,  there  is  little  difference  between  the  aperture  transmis¬ 
sion  pattern  P(|,  r|)  and  the  detector  pattern  A(x,  y),  in  the 


optical  regime  diffraction  effects  lead  to  a  marked  difference 
between  P(^,  r|)  and  A(x,  y).  Thus  according  to  a  method 
embodiment  described  in  greater  detail  below,  P(!j,  r|)  for 
focusable  radiation  will  be  calculated  from  the  desired  A(x, 

y)- 

[0033]  Since  A(x,  y)  is  an  intensity  pattern  formed  by  dif¬ 
fraction  from  a  finite  aperture,  D,  of  P(^,  r|),  A(x,  y)  must  be 
real,  non-negative,  and  band-limited.  Once  A(x,  y)  is  deter¬ 
mined,  a  standard  phase  retrieval  algorithm  such  as  reported 
by  J.  R.  Fienup,  Opt.  Lett.  3  (1 978)  27  or,  by  R.  Rolleston,  N. 
George,  Appl.  Opt.  25  (1986)  178  may  be  used  to  calculate  the 
coded-aperture  transmission  function  P(§,  r|).  To  begin,  let 
t(x,  y)  be  the  binary  function  for  the  URA  in  coded-aperture 
imaging  as  described,  e.g.,  by  E.  E.  Fenimore,  T.  M.  Camion, 
Appl.  Opt.  1 7  (1978)  337.  As  shown  in  the  inset  in  FIG.  2,  this 
pattern  has  sharp  edges  and  thus  is  not  band-limited.  Even 
though  the  idealized  binary  edges  are  not  realizable  when 
diffraction  is  taken  into  account,  a  solution  is  sought  for  A(x, 
y)  that  is  realizable,  as  follows: 

[0034]  t(x,  y)  is  convolved  with  a  non-negative,  band-lim¬ 
ited  blocking  function  b(x,  y)  according  to 

Ax.y)=ffK 1,  y-r\)d%d  u"  ‘(x.y)*b(x,y),  (i) 

where  *  is  the  convolution  operation.  For  focusable  radiation, 
A(x,y)  must  be  band-limited  with  appropriate  bandwidth  to 
provide  an  operable  solution  for  the  phase  screen  transmis¬ 
sion  function  P(§,  r|). 

[0035]  For  the  imaging  application  as  shown  in  FIG.  1A, 
for  an  object  0(x,  y),  the  image  I(x,  y)  in  a  noise-free  system 


can  be  written  as 

I(x,y)=jjA{x-x',  y-y')0(x',  y‘)dx'dy'  -  A(x,y)*0(x,y).  (2) 

[0036]  In  the  coded  image  recovery,  the  estimated  object  O 
is  calculated  as  the  correlation  of  I(x,y)  and  t^(x,  y)  as: 

0(x,  y)=ffts(x',  y')I(x- x',  y-y^dx'dy'  -  I(x,y) Cl  tR(x,y),  (3) 

where  D  is  the  correlation  operator  and 

‘x(x,y)=ff[t(x-x',  y-y‘)-tavg]comb(x'/Dx,  y/Dy)dx'dy',  (4) 

in  which  Dx  and  are  the  size  of  the  URA  t(x,y)  in  x  and  y 
directions,  respectively;  and 

DJ,]-'5_Dxl2EK'2S-D,i2Dyl2Kx.y)dxdy  (5) 

is  the  average  of  the  function  t(x,y);  and 

comb(x,  r)=2j,.  b(x- 1 ,  y-f),  (6) 

is  a  comb  function. 


[0037]  Combining  Esq.  (l)-(4)  yields  the  result  of  Q(x,  y) 
as  follows: 

0(x,  y)=t(x,  y)U  t(x,  y)-tavg]*comb(x'Dx,  y'/Dy)*b(x, 

y)*0(x,  y),  (7) 

where  the  sequence  of  convolution  and  correlation  operations 
is  from  left  to  right. 

[0038]  The  URA  t(x,y)  as  shown  in  FIG.  2  has  the  following 
correlation  property: 

t(x,y) d  t(x,  r)-C,v„!*coinbfx'//tt,  y’/lyy-dcombix/D,, 
y/DyflMx/AjAty/^)],  (8) 

where  C  is  a  constant,  and  A(x)=max(l  Ixl,  0)  is  a  triangle 
function;  as  shown  in  FIG.  2,  AT  and  Av  are  the  smallest  feature 
size  of  the  array  in  x  and  y  directions,  respectively.  Plotting 
Eq.  (8),  one  obtains  an  ideal  correlation  function  with  no 
background  variations  or  “artifacts”.  This  type  of  cyclic  cor¬ 
relation  is  described  in  detail  in  E.  E.  Fenimore,  T.  M.  Can¬ 
non,  Appl.  Opt.  17  (1978)  337  and  represents  a  considerable 
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advancement  over  the  random  array  of  pinholes  reported  in  R. 
H.  Dicke,  Astrophys.  J.  153  (1968)  L101. 

[0039]  Substituting  Eqs.  (8)  into  (7)  provides  the  estimate 
of  object  Q(x,  y)  as: 

0(x,  y) = Ccom b (x/Dx,  y/Dy)* [A(x/Ax) A^/A^)])*/?^, 

y)*0(x,y).  (9) 

[0040]  Eq.  (9)  shows  the  recovered  object  and  its  shifted 
versions.  If  the  field  of  view  is  constrained  in  the  following 
form: 

-DJ2SDJ2  and  -DJ2&DJ2.  (10) 

then  there  is  no  overlap  in  shifted  versions  of  the  object  and 
the  object  Q;(x,  y)  can  be  recovered  as 

d,(x,  y)=C[A(x/Ax)A(y/Ay)\,b(x,  y)*0(x,  y).  (11) 

The  field  of  view  constraint  in  Eq.  (10)  is  in  image  space,  i.e., 
x  and  y  in  Eq.  1 0  are  the  Cartesian  coordinates  at  the  detector 
plane  II. 

[0041]  FromEq.  (11),  thePSF  of  the  coded  aperture  system 
100-1  in  the  optical  region  p(x,  y)  can  be  written  as: 

p(x,  y)=[A(x/Ax)A(y/Ay)]*b(x,  y), 

p(x ,  y)=ff[A(x'/Ax)A(y'/Ay)]b(x-x',  y-y')dx'dy'.  (12) 

This  point  spread  function  combines  both  the  optical  imaging 
and  the  correlation  type  digital  processing. 

[0042]  From  Eq.  (12),  the  correlation  type  digital  process¬ 
ing  yields  an  image  blurred  by  two  parts:  the  smallest  feature 
size  of  the  uniformly  redundant  array  t(x,  y)  and  the  band- 
limited  function  b(x,  y).  In  the  detection  process,  the  object 
information  with  spatial  frequencies  higher  than  the  band 
limit  of  b(x,  y)  is  lost  due  to  diffraction  by  the  phase  screen 
P(x,  y)  of  a  finite  size.  Without  extra  object  constraint,  it  is 
beneficial  to  not  remove  this  blur  function  b(x,  y),  even  for  an 
imaging  system  with  a  diffraction  limited  lens,  in  which  case 
b(x,  y)  is  an  Airy  disk  for  a  circular  aperture. 

Detailed  System  Design 

[0043]  The  following  description  explains  in  detail  how  to 
determine  A(x,  y)  for  focusable  radiation  according  to  an 
embodiment  of  the  invention.  To  determine  A(x,  y),  the  func¬ 
tions  b(x,  y)  and  t(x,  y)  must  be  defined. 

Defining  b(x,  y) 

[0044]  For  the  band-limited  function  A(x,  y),  it  is  advanta¬ 
geous  to  know  the  cutoff  frequency.  Here  we  note  that  any 
signal  with  finite  duration  is  not  considered  to  be  band-lim¬ 
ited  for  the  purpose  of  the  instant  invention;  however,  we 
consider  band-limited  as  used  herein  as  follows. 

[0045]  With  reference  again  to  FIG.  1A,  we  consider  only 
the  y-component  of  the  electric  field.  The  incoming  field  from 
a  point  source  O  is  incident  on  and  passes  the  phase  screen  50. 
Assuming  implicit  exp(+imt)  dependence  at  plane  I  immedi¬ 
ately  after  the  phase  screen,  one  can  write  the  electric  field  as 

£,-d>n)=exp[H|>(i,n]-  (13) 

[0046]  Using  Rayleigh-Sommerfield  diffraction  theory, 
one  can  calculate  the  field  at  plane  II  at  a  distance  z  from  plane 
I  as  follows: 

£0(x,y,z)=JJexp[/(j)(^,  ,i\\(e^iklil2x,k)(ik+\IR ){z/R )doldi\,  (14) 

where  R=[z2+(x-|)2+(y-r|)2]1/2. 


[0047]  The  spatial  spectrum  E0(fv,  I' )  of  the  electric  field  at 
plane  II  is  defined  as 

E0(Lfy)=ffE0(x.y,z)exp[-i2x(fxx+fyy)]dxdy,  (15) 

where  fv  and  fv  denote  the  variables  in  the  spatial  frequency 
domain.  Substituting  Eqs.  (14)  into  (15), 

£ote,^)=£,te.^)exp[-<fe(l-7.2te2+/J.2))1'2]-  (16) 

where  E,(fv,  fv)  is  the  spatial  spectrum  of  the  electric  field  at 
plane  I  defined  as  follows: 

E0(f„  fy)^SE0(x,y,z)exp  [-i2n(fe+f}y)\dxdy.  (17) 

[0048]  Eq.  (16)  is  the  exact  solution  of  Maxwell’s  Equa¬ 
tions  for  the  y  component  of  the  electric  field  spatial  spectrum 
transfer.  The  field  spatial  spectrum  is  determined  by  two 
terms:  the  spatial  spectrum  of  the  field  at  plane  I  and  the 
transfer  function  as  shown  in  the  second  term  of  Eq.  (16). 
When  the  distance  between  the  phase-only  screen  50  (plane  I) 
and  the  detector  60  (plane  II)  is  much  larger  than  the  wave¬ 
length  of  illumination  k,  then  the  second  term  of  Eq.  (1 6)  is 
subject  to  the  exponential  decay  for  lfT2+fv2l  =  1  A2.  As  such, 
the  cutoff  frequency  in  the  second  term  is  1/X. 

[0049]  In  principle,  the  phase  screen  50  can  be  made  as  fine 
as  possible  and  there  is  no  cutoff  frequency  for  the  first  term 
of  Eq.  (16).  But  in  an  actual  system,  the  diffraction  pattern  at 
the  detector  plane  (plane  II  in  FIG.  1  A)  has  to  be  a  finite  size 
so  that  it  can  be  fully  collected  by  the  detector.  Thus  the  cutoff 
frequency  of  the  first  term  in  Eq.  (16)  is  determined  by  the 
optical  configurations.  In  an  exemplary  aspect,  the  Cartesian 
(x,  y)  dimensions  of  the  URA  intensity  pattern  A(x,  y)  on  the 
detector  60  are,  respectively,  half  that  of  the  detector  dimen¬ 
sions  X,  Y. 

[0050]  In  a  thin  imaging  device  configuration,  i.e.,  the  dis¬ 
tance  z  between  planes  I  and  II  in  FIG.  1 A  is  smaller  than  the 
coded-aperture  size  D,  it  is  generally  the  second  term  of  Eq. 
(16)  that  will  determine  the  cutoff  frequency  of  the  electric 
field  E0(x,  y)  at  plane  II  of  FIG.  1A.  In  a  thick  configuration, 
z>D,  the  diffraction  limited  resolution  size  8  at  the  detector 
plane  (II)  can  be  estimated  by  the  well  known  formula: 

6 =Xz/D.  (18) 

[0051]  Thus  the  cutoff  frequency  of  E0(x,  y)  for  a  thick 
configuration  can  be  approximated  as 

imaJ,Hb~D/'kz.  (19) 

[0052]  From  the  above  analysis,  the  cutoff  frequency  fEmax 
of  the  electric  field  E0(x,  y)  is 

hw”min[  1 IX,  D/X,z] .  (20) 

[0053]  After  the  cutoff  frequency  of  E0(x,  y)  is  determined, 
the  cutoff  frequency  of  the  intensity  pattern  A(x,  y)  at  plane  II 
of  FIG.  1A  can  be  written  as: 

A(x,y)-\Ea(x,y,z)  I2.  (21) 

[0054]  From  Fourier  transform  theory,  the  spatial  spectrum 
of  the  intensity  pattern  A(x,  y)  can  be  written  as  an  autocor¬ 
relation  as: 

A0(f„fy)=SE0(fx,fy)E0{rx-f„fy-fy)dfJfy  (22) 

[0055]  Clearly,  the  cutoff  spatial  frequency  fAmax  of  the 
intensity  pattern  A(x,  y)  is  twice  that  of  the  electric  field 
E0(x,y,z),  or, 


f<wmui[2 IX,  2D/X.Z], 


(23) 
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[0056]  In  an  actual  electronic  imaging  system,  there  is  one 
more  factor  that  should  be  considered  in  the  design  of  the 
band-limited  intensity  pattern  A(x,  y).  The  detector  array  can 
only  sample  the  pattern  in  finite  intervals.  To  avoid  an  aliasing 
effect,  A(x,  y)  needs  to  be  band-limited  up  to  the  Nyquist 
frequency.  Assuming  the  distance  between  neighboring  pix¬ 
els  of  the  detector  is  A,  then  the  highest  spatial  frequency  of 
A(x,  y)  set  by  the  detector  sampling  is  1/2A. 

[0057]  One  way  to  find  a  nonnegative,  band-limited  signal 
A(x,  y)  is  to  convolve  a  not  band-limited  signal  with  a  non¬ 
negative  band-limited  function  b(x,  y).  b(x,  y)  must  have  an 
upper  spatial  frequency  equal  to  the  cutoff  frequency  of  the 
pattern  A(x,  y),  which  is  the  lesser  value  of  fAmax  as  in  Eq.  (23) 
and  1/2A.  As  one  example,  b(x,  y)  can  be  an  intensity  point 
spread  function  of  a  diffraction  limited  lens  with  an  appro¬ 
priate  size  finite  aperture;  the  cutoff  frequency  is  then  deter¬ 
mined  by  the  aperture  size  of  the  lens  as  is  well  known  in 
Fourier  optics. 

Defining  t(x,  y) 

[0058]  In  mathematics  andX-ray  imaging  applications,  it  is 
well  known  that  the  uniformly  redundant  array  has  a  perfect 
correlation  property,  as  shown  in  Eq.  (8).  That  is,  the  corre¬ 
lation  in  Eq.  (8)  does  not  have  background  variations  that  can 
introduce  extra  noise  in  the  recovered  image  even  with  a  noise 
free  detection  process.  This  is  an  important  criterion  in  the 
choice  of  t(x,  y).  Any  pattern  with  such  correlation  property  as 
shown  in  Eq.  (8)  will  work  in  the  system  design.  In  a  non¬ 
limiting,  illustrative  aspect,  we  use  a  uniformly  redundant 
array  as  a  starting  point.  A  uniformly  redundant  array  is  a  two 
dimensional  binary  array  whose  cyclic  autocorrelation  has 
constant  side  lobes.  One  example  of  the  URA  in  a  matrix 
format,  ty  with  a  size  of  rxs,  is  known  as  follows: 

'0  if  i  =  0,  (24) 

1  if  j  =  0  &  i  =£  0, 

tij  = 

1  if  C(r,  i)C(s,  j)  =  1, 

.  0  otherwise, 

where  t  and  s  are  two  prime  numbers,  r-s=2,  and 

{1  if  there  exists  an  integer  n.  1  ^  n  <  r,  (25) 

such  that  i  —  n2  ■  mod(r) 

- 1  otherwise. 

We  note  that  all  the  cyclic  shifted  versions  of  XtJ  above  are  also 
URAs  because  their  cyclic  autocorrelation  functions  have 
constant  sidelobes. 

[0059]  In  the  instant  system  design,  we  choose  two  param¬ 
eters  in  the  URA,  the  feature  size  of  the  array  AT,  Av  and  the 
total  array  size  D_T  and  D  . 

[0060]  Eq.  (12)  shows  that  in  order  to  have  the  best  resolu¬ 
tion  of  the  system,  AT  and  Av  should  be  as  small  as  possible. 
However,  another  limiting  factor  is  that  A(x,  y),  as  calculated 
in  Eq.  (1),  should  have  good  contrast.  From  Eq.  (1),  the 
contrast  of  A(x,  y)  is  larger  for  laiger  feature  size  of  the 
uniformly  redundant  array.  By  considering  both  Eqs.  (1)  and 
(12),  one  can  set  AT  and  Av  to  be  about  the  same  as  the  feature 
size  of  b(x,  y);  or  mathematically, 

~land2ArfrMm~l,  (26) 


where  fxMax  and  fyMax  are  the  largest  spatial  frequency  of  b(x, 
y)  in  the  x  and  y  directions,  respectively. 

[0061]  The  total  size  DT  and  Dv  of  the  array  t(x,  y)  can  be 
determined  from  the  field  of  view  constraint  in  Eq.  (10).  For 
a  detector  with  a  size  of  XxY,  Eq.  (10)  needs  to  be  true  for  any 
point  (x,y)  at  detector  (lxl<X/2  and  lyl<Y/2).  This  implies 
that  I  )x  and  D  need  to  satisfy  the  following: 

D.fiX/2  and  Dy^Y/2.  (27) 

Calculating  the  Phase-Only  Screen  Transmission  Function 

P(l,  "n) 

[0062]  After  the  band-limited  intensity  pattern  A(x,  y)  is 
known,  the  next  step  in  the  system  design  is  to  calculate  an 
aperture  with  a  transmission  function  of  P(§,  r|)  that  can  be 
used  to  generate  the  specific  intensity  pattern  A(x,  y). 
Although  a  phase-only  type  aperture  may  be  preferred  in 
many  applications,  a  phase  retrieval  process  500  as  shown  in 
FIG.  5  can  be  used  for  a  phase-only  type  aperture,  an  ampli¬ 
tude-only  type  aperture,  or  a  combination  amplitude/phase- 
type  aperture,  which  can  be  either  of  a  transmission-type  or  a 
reflection-type.  The  calculation  method  involves  an  iterative 
phase  calculation. 

[0063]  In  FIG.  5,  the  process  500  starts  at  step  501  with  an 
electric  field  having  an  amplitude  of  E(x,  y)=[A(x,  y)]1/2.  At 
step  502  a  free  space  back  propagation  is  used  to  calculate  the 
aperture  function  at  plane  I  of  FIG.  1A.  We  denote  this  aper¬ 
ture  function  as  IP(§,  r|)lexp[i<)>(l;,  r))  at  step  50.3.  In  order  to 
find  a  desired  phase-only  screen,  according  to  an  illustrative 
aspect,  we  set  the  aperture  constraint,  i.e.,  change  IP(§,  r|)l  to 
1 ,  at  step  505.  At  step  506,  a  free  space  propagation  is  applied 
to  find  the  electric  field  at  detector  plane  II  as  shown  in  FIG. 
1  A,  at  step  507.  We  denote  the  thus  found  electric  field  as  F (x, 
y)exp[ii]i(x,  y).  The  detector  plane  intensity  constraint  is  then 
applied  at  step  509,  i.e.,  change  F(x,  y)  to  [A(x,  y)]1/2.  At  step 
510,  we  perform  another  free  space  back  propagation,  and  the 
process  is  repeated.  Using  this  iterative  approach,  we  even¬ 
tually  can  calculate  a  phase-only  screen  P(|,  r|)  that  will 
generate  the  required  intensity  pattern  A(x,  y). 

[0064]  In  this  algorithm,  the  free  space  propagation  and 
back  propagation  can  be  simply  calculated  exactly  in  the 
spatial  frequency  domain  using  Eq.  (16).  Therefore  this  cal¬ 
culation  is  good  in  non-paraxial  case  when,  for  example,  the 
distance  between  the  screen  and  detector  planes  are  smaller 
than  the  aperture  size  of  the  screen  (i.e.,  thin  camera  configu¬ 
ration). 

[0065]  According  to  an  alternative  illustrative  aspect,  the 
process  500  can  be  carried  out  for  an  amplitude-only  coded- 
aperture  by  simply  setting  the  aperture  constraint  differently, 
i.e.,  setting  <j)(|,  r|)  to  0  in  step  503,  then  performing  the  steps 
as  recited  above.  According  to  a  further  alternative,  illustra¬ 
tive  aspect  in  which  a  combination  amplitude/phase  aperture 
is  used,  only  a  single  iteration  is  necessary  to  determine  the 
appropriate  transmission  function.  Thus  regardless  of  the 
type  of  phase  screen  being  designed  and  used,  the  same 
rationale  controls;  i.e.,  design  a  coded-aperture  system,  with 
or  without  lens,  whose  diffraction  pattern  is  a  band-limited 
URA.  In  this  regard,  a  single  or  multiple  refractive  element(s) 
(e.g.,  lens(es))  or  a  combination  of  lens(es)  plus  phase  mask 
could  be  utilized  for  P(§,  r|)  to  generate  the  required  intensity 
pattern  A(x,  y)  for  focusable  radiation.  For  example,  an 
optional  negative  lens  with  a  1  nun  aperture  in  combination 
with  a  phase  plate  could  be  used  for  a  5  nun  detector  system. 
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Alternatively,  an  optional  positive  lens  may  be  used  in  com¬ 
bination  with  a  phase  plate  if  the  size  of  aperture  is  larger  than 
half  the  size  of  detector. 

[0066]  While  phase  retrieval  algorithms  in  the  above 
description  are  generally  known  in  the  literature,  we  note  that 
in  our  system  design  some  extra  data  constraints  as  reported 
in  R.  G.  Paxman,  T.  J.  Schulz,  J.  R.  Fienup,  J.  Opt.  Soc.  Am. 
A  9  (1992)  1072  may  be  used  in  the  phase  retrieval  algorithm 
to  improve  the  performance  of  the  coded  aperture  system.  As 
one  example,  in  order  to  have  an  extremely  wide  field  of  view, 
we  calculate  a  phase-only  screen  that  can  generate  a  similar 
intensity  pattern  for  both  an  on-axis  object  point  and  an  off- 
axis  point  source.  Similar  extra  data  constraints  may  be  used 
to  design  a  system  with  large  depth  of  field  or  to  reduce  the 
sensitivity  of  intensity  pattern  dependence  on  parameter  z,  the 
distance  between  the  phase  screen  and  the  detector  plane. 

Simulation  Results 

[0067]  In  FIG.  3 a,  we  show  a  realizable  band-limited  inten¬ 
sity  pattern  A(x,  y)  301  at  the  detector  plane  (II;  not  shown). 
It  is  the  image  of  the  known  uniformly  redundant  array  t(x,  y ) 
201  shown  in  FIG.  2  by  a  diffraction  limited  square  aperture 
lens  (not  shown)  and  is  generated  digitally  from  Eq.  (1).  A 
section  of  the  pattern  A(x,  y)  301  is  magnified  to  see  the 
detailed  features  of  such  a  pattern.  The  edge  is  blurred  com¬ 
pared  to  that  of  the  uniformly  redundant  array  201  in  FIG.  2. 
FIG.  3b  shows  the  corresponding  phase  function  303  that  can 
generate  such  a  pattern  (301)  for  focusable  light  from  an  axial 
point  source  at  infinity.  The  phase  values  from  -x  to  it  are 
shown  from  dark  to  bright.  In  this  simulation  we  use  the 
following  parameters:  Both  the  sizes  of  the  pattern  A(x,  y) 
301  and  phase  screen  P(x,  y)  303  are  2  mmx2  nun,  and  the 
distance  between  the  phase  screen  and  the  detector  is  z=5  mm 
The  wavelength  of  illumination  is  X =4  pm. 

[0068]  The  imaging  results  are  shown  in  FIGS.  4 (a-c).  FIG. 
4 a  shows  the  object  used  in  simulation;  FIG.  4b  shows  the 
decoded  image  using  the  correlation  method  described  herein 
above;  FIG.  4c  shows  a  comparative  image  formed  by  a 
diffraction  limited  lens  with  the  same  square  aperture.  One 
can  observe  the  excellent  imaging  results  for  the  coded  aper¬ 
ture  system  as  shown  in  FIG.  4b.  The  image  of  the  coded 
aperture  system  is  a  little  more  blurry  than  that  of  the  diffrac¬ 
tion  limited  lens  because  the  point  spread  function  of  such  a 
system,  as  in  Eq.  (12),  is  wider  than  that  of  the  diffraction 
limited  system.  Some  extra  digital  deconvolution  can  be 
applied  to  the  image  in  FIG.  4b  to  remove  the  effect  of  the 
triangle  blur  function  in  Eq.  (12)  and  recover  a  diffraction 
limited  result.  This  extra  blur  is  not  a  significant  disadvantage 
of  the  optical  region  coded  aperture  imaging  system. 

[0069]  Advantageously,  embodiments  of  the  systems 
described  herein  can  be  extraordinarily  simple.  In  an  illustra¬ 
tive  system  aspect  100-1  as  shown  in  FIG.  1A,  the  optical 
subsystem  includes  only  a  phase-only  screen  50  followed  by 
a  detector  array  60  (and  image  processor  90),  while  a  conven¬ 
tional  diffraction  limited  lens  is  comparatively  difficult  to 
design  and  fabricate,  especially  in  an  ultra-thin  format  com¬ 
parable  to  the  instant  coded-aperture  system.  The  embodied 
system  works  both  in  the  visible  and  infrared  optical  region. 
The  simplicity  of  the  embodied  infrared  system  is  clearly  an 
advantage  compared  to  conventional  infrared  imaging  sys¬ 
tems. 

Image  Recovery 

[0070]  In  addition  to  the  correlation-type  processing 
described  with  respect  to  FIG.  5,  above,  alternative  known 


methods  may  include  photon  tagging,  linear  filtering,  maxi¬ 
mum  entropy,  and  iterative  removal  of  sources. 

[0071]  FIG.  6  shows  an  image  601  recovered  using  the 
correlation  type  processing  as  described  hereinabove  and  is 
similar  to  that  shown  in  the  FIG.  4b,  except  that  in  FIG.  6  a 
Gaussian  noise  is  added  to  the  intermediate  coded  image.  The 
standard  deviation  of  the  Gaussian  noise  is  one  percent  (1%) 
of  that  of  the  signal  value  of  the  intermediate  image.  In  the 
system  as  shown  in  FIG.  1A,  the  detector  linear  size  is  twice 
that  of  the  pattern  size  A(x,  y)  (See  Eq.  10);  the  dark  and  bright 
structure  of  the  object  is  not  seen  in  the  intermediate  image. 
The  intermediate  image  is  bright  at  the  center  and  it  tapers  to 
dark  at  the  edge  of  the  detector.  The  noise  added  to  the 
intermediate  image  has  a  standard  deviation  that  is  one  per¬ 
cent  of  the  intermediate  image,  so  the  noise  added  to  the 
center  is  much  larger  than  the  noise  added  to  the  edge  of  the 
intermediate  image. 

[0072]  In  order  to  illustrate  the  effectiveness  of  the  instant 
novel  camera  system  with  an  image  that  displays  gray  scale, 
FIG.  7  shows  the  simulated  imaging  results  using  the  object  of 
a  hummingbird.  FIG.  la  shows  the  diffraction  limited  image 
taken  with  a  diffraction  limited  lens  with  the  same  aperture 
size  as  that  of  the  embodied  phase-coded  aperture  system, 
i.e.,  2  mmx2  mm  aperture.  The  recovered  image  using  the 
phase-coded  aperture  system  is  shown  in  FIG.  lb.  No  noise  is 
included  in  the  intermediate  image  for  the  coded-aperture 
system.  A  careful  comparison  of  the  high  frequency  detail  and 
variable  contrast  shows  excellent  image  quality.  Even  small 
contrast  variations  in  the  upper  rail  of  the  wooden  fence  are 
clearly  observed  in  the  image.  Although  not  shown  in  the 
figures,  good  image  recovery  results  were  also  obtained  with 
1%  noise  added  to  the  intermediate  image  at  the  detector 
plane. 

[0073]  A  phase-only  coded-aperture  and  associated  system 
are  illustrative  embodiments  of  the  invention.  As  mentioned 
above,  in  alternative  illustrative  aspects,  the  coded-aperture 
may  be  an  amplitude-only  optical  element  or  a  combination 
amplitude/phase  optical  element,  and  respective,  alternative 
illustrative  systems  may  incorporate  same.  For  example,  FIG. 
IB  shows  an  alternative  illustrative  coded-aperture  imaging 
system  100-2  in  which  the  coded-aperture  50-1  is  a  program¬ 
mable  reflective-type  liquid  crystal,  such  as  the  Holoeye  HEO 
1080P  programmable  spatial  light  modulator.  Each  pixel  of 
the  modulator  can  be  programmed  to  phase  change  over  a 
range  of  2re  and  thus  can  be  used  as  a  reflective  phase  plate.  In 
the  experimental  setup  shown  in  FIG.  IB,  each  pixel  of  the 
spatial  light  modulator  was  8  pm;  the  fill  factor  was  85%;  and 
a  0-2it  phase  modulation  was  at  ^=0.633  pm.  Detector  pixels 
were  13  pm.  The  object  was  located  1275  nun  from  the  phase 
screen  and  the  phase  screen  to  detector  separation  was  204.4 
nun  The  aperture  was  5.5  mmx5.5  mm. 

[0074]  FIG.  8  shows  a  point  source  image  and  recovery 
using  the  experimental  system  setup  100-2  shown  in  FIG.  IB 
and  the  phase  retrieval  method  500  illustrated  in  FIG.  5. 
[0075]  Fabrication  of  transmission-type  or  reflection-type 
coded-aperture  optical  elements  as  embodied  herein  can  be 
made  using  photolithographic  processes  well  known  in  the 
semiconductor  art.  Once  a  master  is  made  via  photolithogra¬ 
phy,  quantities  of  coded-aperture  optical  elements  can  be 
made  by  well  known  molding  processes.  Transmission-type 
elements  may  be  made  using  dielectric  materials  such  as  glass 
and  plastic,  for  example.  Reflection-type  elements  can  be 
made  from  a  variety  of  metals  or  other  materials  that  can  be 
reflection  coated. 
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[0076]  All  references,  including  publications,  patent  appli¬ 
cations,  and  patents  cited  herein  are  hereby  incorporated  by 
reference  in  their  entireties  to  the  same  extent  as  if  each 
reference  were  individually  and  specifically  indicated  to  be 
incorporated  by  reference  and  were  set  forth  in  its  entirety 
herein. 

[0077]  The  use  of  the  tenns  “a”  and  “an”  and  “the”  and 
similar  referents  in  the  context  of  describing  the  invention 
(especially  in  the  context  of  the  following  claims)  are  to  be 
construed  to  cover  both  the  singular  and  the  plural,  unless 
otherwise  indicated  herein  or  clearly  contradicted  by  context. 
The  terms  “comprising,”  “having,”  “including,”  and  “con¬ 
taining”  are  to  be  construed  as  open-ended  terms  (i.e.,  mean¬ 
ing  “including,  but  not  limited  to ,”)  unless  otherwise  noted. 
The  term  “connected”  is  to  be  construed  as  partly  or  wholly 
contained  within,  attached  to,  or  joined  together,  even  if  there 
is  something  intervening. 

[0078]  The  recitation  of  ranges  of  values  herein  are  merely 
intended  to  serve  as  a  shorthand  method  of  referring  individu¬ 
ally  to  each  separate  value  falling  within  the  range,  unless 
otherwise  indicated  herein,  and  each  separate  value  is  incor¬ 
porated  into  the  specification  as  if  it  were  individually  recited 
herein. 

[0079]  All  methods  described  herein  can  be  performed  in 
any  suitable  order  unless  otherwise  indicated  herein  or  oth¬ 
erwise  clearly  contradicted  by  context.  The  use  of  any  and  all 
examples,  or  exemplary  language  (e.g.,  “such  as”)  provided 
herein,  is  intended  merely  to  better  illuminate  embodiments 
of  the  invention  and  does  not  impose  a  limitation  on  the  scope 
of  the  invention  unless  otherwise  claimed. 

[0080]  No  language  in  the  specification  should  be  con¬ 
strued  as  indicating  any  non-claimed  element  as  essential  to 
the  practice  of  the  invention. 

[0081]  It  will  be  apparent  to  those  skilled  in  the  art  that 
various  modifications  and  variations  can  be  made  to  the 
present  invention  without  departing  from  the  spirit  and  scope 
of  the  invention.  There  is  no  intention  to  limit  the  invention  to 
the  specific  form  or  forms  disclosed,  but  on  the  contrary,  the 
intention  is  to  cover  all  modifications,  alternative  construc¬ 
tions,  and  equivalents  falling  within  the  spirit  and  scope  of  the 
invention,  as  defined  in  the  appended  claims.  Thus,  it  is 
intended  that  the  present  invention  cover  the  modifications 
and  variations  of  this  invention  provided  they  come  within  the 
scope  of  the  appended  claims  and  their  equivalents. 

We  claim: 

1.  An  optical  element  for  generating  a  band-limited  uni¬ 
formly  redundant  array  (bl-URA)  from  light  within  a  spec¬ 
trum  of  focusable  radiation,  comprising: 

an  optical  element  characterized  by  a  light  transmission 
function,  P(|,  r|),  such  that  light  within  the  spectrum  of 
focusable  radiation  incident  on  the  optical  element  from 
a  point  location  in  an  object  space  of  the  optical  element 
is  optically  transformed  by  P(S,,  r|)  into  a  band-limited 
uniformly  redundant  array  (bl-URA),  A(x,y),  in  an 
image  space  of  the  optical  element. 

2.  The  optical  element  of  claim  1,  wherein  the  optical 
element  consists  of  a  single  optical  element. 

3.  The  optical  element  of  claim  1,  wherein  the  optical 
element  has  a  surface  region  that  is  at  least  partially  transmis¬ 
sive  for  the  light  within  the  spectrum  of  focusable  radiation. 

4.  The  optical  element  of  claim  1,  wherein  the  optical 
element  has  a  surface  region  that  is  at  least  partially  reflective 
for  the  light  within  the  spectrum  of  focusable  radiation. 


5.  The  optical  element  of  claim  1,  wherein  the  optical 
element  is  an  amplitude-only  aperture. 

6.  The  optical  element  of  claim  1,  wherein  the  optical 
element  is  a  phase-only  aperture. 

7.  The  optical  element  of  claim  1,  wherein  the  optical 
element  is  a  combination  amplitude/phase  aperture. 

8.  The  optical  element  of  claim  1,  wherein  the  optical 
element  consists  of  a  refractive  optical  component. 

9.  The  optical  element  of  claim  1,  wherein  the  optical 
element  consists  of  a  plurality  of  refractive  optical  compo¬ 
nents. 

10.  The  optical  element  of  claim  1,  wherein  the  optical 
element  comprises  a  refractive  optical  component  and  a  phase 
aperture. 

11.  The  optical  element  of  claim  1,  wherein  the  optical 
element  is  a  programmable  spatial  light  modulator. 

12.  The  optical  element  of  claim  1,  wherein  the  optical 
element  has  Cartesian  x,y  surface  dimensions  equal  to  or 
greater  than  one  millimeter,  respectively. 

13.  The  optical  element  of  claim  1,  wherein  A(x,y)  is  a  real, 
non-negative,  band-limited,  uniformly  redundant  array  (bl- 
URA). 

14.  The  optical  element  of  claim  1,  wherein  the  spectrum  of 
focusable  radiation  is  in  a  range  from  ultraviolet  to  sub¬ 
millimeter  wavelengths. 

15.  The  optical  element  of  claim  14,  wherein  the  spectrum 
of  focusable  radiation  is  in  a  range  from  visible  to  infrared 
wavelengths. 

16.  An  optical  imaging  device,  consisting  of: 

an  optical  element  characterized  by  a  light  transmission 
function,  P(^,  r|),  such  that  light  within  the  spectrum  of 
focusable  radiation  incident  on  the  optical  element  from 
a  point  location  in  an  object  space  of  the  optical  element 
is  optically  transformed  by  P(§,  r|)  into  a  band-limited 
uniformly  redundant  array  (bl-URA),  A(x,y),  in  an 
image  space  of  the  optical  element; 

a  detector  disposed  in  the  image  space  such  that  the  bl- 
URA  is  formed  on  the  detector;  and 

an  image  processor  adapted  to  recover  an  image  of  an 
object  from  the  detected  bl-URA. 

17.  The  optical  imaging  device  of  claim  16,  wherein  A(x,y) 
is  a  real,  non-negative,  intensity  pattern  and  the  optical  ele¬ 
ment  characterized  by  P(|,  r|)  has  a  finite  aperture  size. 

18.  The  optical  imaging  device  of  claim  16,  whereinA(x,y) 
is  a  convolution  of  a  binary  function  t(x,y)  for  uniformly 
redundant  array  with  a  non-negative,  bandlimited  blocking 
function  b(x,y),  as  follows: 

"  t(x,y)*b(x,y), 

where  *  is  the  convolution  operation. 

19.  The  optical  imaging  device  of  claim  18,  wherein  A(x,y) 
is  a  point  spread  function  p(x,y)  described  by: 

p(x,y)=[A(x/AJA(y/Ay)]*b(x,y), 
p(x,y)=ff[A(x'/AJA(y'/Ay)]b(x-x',  y-y')dx'dy', 

where  A(x)=max(  1 — Ixl ,  0)  is  a  triangle  function  and  Ax  and  Av 
are  the  smallest  feature  size  of  the  bl-URA  in  x  and  y  direc¬ 
tions,  respectively,  at  the  detector. 

20.  The  optical  imaging  device  of  claim  18,  wherein  the 
bandlimited  blocking  function  b(x,y)  is  an  Airy  disc  for  a 
circular  aperture. 

21.  The  optical  imaging  device  of  claim  20,  wherein  the 
bl-URA  has  a  cut-off  frequency  as  follows: 
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where  i yMax  31-6  the  largest  spatial  frequency  of  b(x,y)  in 

x  and  y  directions,  respectively,  at  the  detector. 

22.  The  optical  imaging  device  of  claim  16,  wherein  A(x,y) 
at  the  detector  has  an  x-dimension  and  a  y-dimension  that  are 
equal  to  or  less  than  a  total  size  X/2  and  Y/2,  respectively, 
where  the  detector  has  a  size  of  XxY. 

23.  The  optical  imaging  device  of  claim  16,  wherein  the 
object  is  a  continuous  object. 

24.  The  optical  imaging  device  of  claim  17,  wherein  the 
optical  element  and  the  detector  are  separated  by  a  distance,  z, 
that  is  less  than  the  finite  aperture  size  of  the  optical  element. 

25.  The  optical  imaging  device  of  claim  16,  wherein  the 
device  is  a  computational  imaging  camera. 

26.  A  method  for  determining  a  transmission  function  P(^, 
r| )  for  an  optical  element  that  will  generate  a  desired  intensity 
pattern  A(x,y)  on  a  detector  from  light  within  a  spectrum  of 
focusable  radiation  from  a  point  on  an  object,  comprising: 

a)  determining  a  real,  non-negative,  band-limited  uni¬ 
formly  redundant  array,  A(x,y),  that  will  be  generated  on 
a  detector  by  an  optical  element  characterized  by  a  trans¬ 
mission  function  P(§,  r|),  from  light  within  the  spectrum 
of  focusable  radiation  from  a  point  on  the  object; 

b)  defining  an  electric  field  having  an  amplitude  E(x,y)= 
[A(x,y)]1/2; 


c)  calculating  the  transmission  function  P('§,  r\)  in  a  plane 
immediately  adjacent  a  known  position  of  the  optical 
element  by  performing  a  free  space  back  propagation, 
and  denoting  the  transmission  function  IP(^,  r|)lexp[i(|> 

d)  determining  an  electric  field  at  a  known  detector  plane 
location  by  performing  a  free  space  propagation,  and 
denoting  this  electric  field  F(x,y)exp[ii|j(x,y)[; 

e)  applying  a  detector  plane  intensity  constraint  by  setting 
F(x,y)^[A(x,y)]1/2; 

f)  performing  another  free  space  back  propagation;  and 

g)  calculating  the  optical  element  transmission  function 
P(5,  "n )  that  will  generate  the  desired  intensity  pattern 
A(x,y). 

27.  The  method  of  claim  26,  further  comprising: 

cl)  after  step  (c),  setting  an  aperture  constraint  such  that 
PI(5,t))I  is  set  to  1,  wherein  the  optical  element  is  a 
phase-only  element;  and 

h)  repeating  steps  (c-f). 

28.  The  method  of  claim  26,  further  comprising: 

cl)  in  step  (c),  setting  <|)(|,  r|)  to  0,  wherein  the  optical 
element  is  an  amplitude-only  element;  and 

h)  repeating  steps  (c-f). 


